An equivalence between high dimensional Bayes optimal inference and M-estimation Supplementary Material
نویسندگان
چکیده
A Useful properties of the Moreau envelope and proximal map 14 A.1 Relation between proximal map and Moreau envelope . . . . . . . . . . . . . . . . 14 A.2 Relation between proximal map and derivative . . . . . . . . . . . . . . . . . . . . 15 A.3 Inverse of the Moreau envelope . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15 A.4 Moreau envelope for additive noise model . . . . . . . . . . . . . . . . . . . . . . 16
منابع مشابه
An equivalence between high dimensional Bayes optimal inference and M-estimation
When recovering an unknown signal from noisy measurements, the computational difficulty of performing optimal Bayesian MMSE (minimum mean squared error) inference often necessitates the use of maximum a posteriori (MAP) inference, a special case of regularized M-estimation, as a surrogate. However, MAP is suboptimal in high dimensions, when the number of unknown signal components is similar to ...
متن کاملBayes Estimation for a Simple Step-stress Model with Type-I Censored Data from the Geometric Distribution
This paper focuses on a Bayes inference model for a simple step-stress life test using Type-I censored sample in a discrete set-up. Assuming the failure times at each stress level are geometrically distributed, the Bayes estimation problem of the parameters of interest is investigated in the both of point and interval approaches. To derive the Bayesian point estimators, some various balanced lo...
متن کاملInference on Pr(X > Y ) Based on Record Values From the Power Hazard Rate Distribution
In this article, we consider the problem of estimating the stress-strength reliability $Pr (X > Y)$ based on upper record values when $X$ and $Y$ are two independent but not identically distributed random variables from the power hazard rate distribution with common scale parameter $k$. When the parameter $k$ is known, the maximum likelihood estimator (MLE), the approximate Bayes estimator and ...
متن کاملOptimal Structural Nested Models for Optimal Sequential Decisions
I describe two new methods for estimating the optimal treatment regime (equivalently, protocol, plan or strategy) from very high dimesional observational and experimental data: (i) g-estimation of an optimal double-regime structural nested mean model (drSNMM) and (ii) g-estimation of a standard single regime SNMM combined with sequential dynamicprogramming (DP) regression. These methods are com...
متن کاملStatistical Mechanics of Optimal Convex Inference in High Dimensions
A fundamental problem in modern high-dimensional data analysis involves efficiently inferring a set of P unknown model parameters governing the relationship between the inputs and outputs of N noisy measurements. Various methods have been proposed to regress the outputs against the inputs to recover the P parameters. What are fundamental limits on the accuracy of regression, given finite signal...
متن کامل